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13  abstract  Mi-  - .  1 

The  subject  of  the  research  is  detection  and  estimation  employing  an 
array  of  sensors.  Of  particular  concern  is  efficient  and  numerically 
reliable  computational  strategies  for  implementing  prevalent 
detection/estimation  procedures.  A  number  of  important  array  processing 
problems  lead  to  a  differencing  of  matrix  outer  products.  This  leads  to 
potential  ill-conditioning  when  implemented  explicitly.  The  avoidance  of 
outer  products,  at  the  expense  of  extra  operations,  has  long  been  a 
crusade  of  sorts  in  the  numerical  analysis  community  (Golub).  One  can  do 
without  outer  products  by  means  of  orthogonal,  or  for  complex  data 
unitary,  transforms  in  the  usual  case  where  a  sum  of  outer  products 
arise.  (Typical  transforms  that  have  been  found  to  be  particularly 
useful  are  Givens,  Jacobi,  and  Householder  transforms).  The  idea  is  to 
transform  the  data  into  sparse  form  while  preserving  its  pertinent 
statistics  (usually  the  sample  convariance  matrix).  This  research 
concerns  generalizing  this  "trick"  to  the  case  of  a  difference  of  outer 
products  by  means  of  hyperbolic,  rather  than  orthogonal  transforms. 


I 


The  ttisk  of  removing  data  (downdating)  arises  in  sensor  arrays  if:  (i)  recursive  block  pro¬ 
cessing  is  employed  for  a  nonstationary  environment  or  (ii)  robust  estimation  is  employed  to 
remove  contamination  from  outliers  [Haykin]. 

Our  contribution  to  this  problem  is  the  development  of  a  stabilized  hyperbolic  transformation 
which  solves  this  problem  [1],[7],  [14],  [18].  We  have  proven  that  our  algorithm  is  indeed  stable 
[1],  and  it  gives  more  accurate  results  than  all  competing  methods  in  simulations  [7], [14], [18],  The 
central  ideas  behind  the  algorithm  are  as  follows.  First  the  problem  statement,  in  mathematical 
terms  is: 

Given:  An  n  by  1  matrix  Ai,  an  n  by  p  matrix  X2  and  a  lower  triangular  (Cholesky) 
matrix  L,  with  LV  =  XiXl  we  seek  the  new  Cholesky  matrix  L  formed  from  down¬ 
dating  ^21  that  is  we  seek  L  such  that: 

iV^LV-X^Xl  (1) 

(Once  we  have  obtained  the  “sparse"’  covariance- invariant  matrix  L  the  least  squares  solution 
is  easy  to  compute.)  Several  computational  solutions  to  (1)  already  exist  which  avoid  outer 
products,  as  outlined  in  [1].  The  most  computationally  efficient  of  these  is  the  hyperbolic 
Householder  transform  [Rader],  developed  by  the  author  with  C.  Rader  at  Lincoln  Laboratory. 
Unfortunately,  although  less  ill-conditioned  than  outer  product  schemes,  it  is  apparently  not 
backwards  stable.  We  modify  it  to  make  it  stable  in  a  fashion  outlined  below. 

Suppose  we  were  given  L  and  X2,  and  we  sought  L.  Then  we  would  have;  L  =  [L\X2]Q  for 
some  orthogonal  matrix  Q,  readily  obtainable  by  standard  techniques.  (In  reality  L  is  unknown 
and  L  is  known.)  The  key  trick  is  this:  form  Q  and  L  “on  the  fly”,  exploiting  the  fact  that  (i) 
Q  is  orthogoncil,  (ii)  L  is  lower  triangular  and  (iii)  the  result  of  the  concomitant  matrix  product 
is  the  known  matrix  L.  This  trick  yields  a  tractable,  albeit  nonlinear,  recursive  procedure  for 
obtaining  L  and  Q  jointly.  The  recursions  involve  hyperbolic  transforms  to  create  Q,  but  once 
Q  is  formed  only  orthogonal  transforms  (which  are  optimally  stable)  are  applied  to  the  data. 

Our  new  stabilized  algorithm  is  the  “best”  choice  (measured  in  terms  of  computational 
efficiency  and  numerical  accuracy)  except  in  certain  c^lses  outlined  in  the  conclusion  of  [7]. 


1.2  Hyperbolic  singular  value  decomposition 

Consider  the  following  problem: 

Given  an  n  by  /  matrix  A'l.  and  an  n  by  p  matrix  X2  find  the  eigenvectors  of  the 
matrix 

A/?  =  A,X{  -  AjA'.  (2) 

This  problem  arises  in  various  array  processing  tasks: 

•  Bearing  estimation  in  colored  noise  using  covariance  differencing  [Paulraj], 
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•  recursive  block  processing  whenever  eigenanalysis  is  employed  in  each  block  (e.g.  high 
resolution  bearing  estimation)  [Haykin],  and 

•  Array  calibration  with  mismatched  sensors.  [Kaveh]  Sensor  mismatch  is  ubiquitous,  arising 
from  differing  antenna  patterns,  variations  in  the  IF  and  I/Q  stages,  etc.  Mismatch, 
if  ignored,  leads  to  serious  performance  degradation.  Therefore  this  is  an  application 
particularly  deserving  of  widespread  interest. 

Our  contribution  to  this  problem  is  the  introduction  of  the  hyperbolic  singular  value  de¬ 
composition  (HSVD)  [2],[8],  [12],  [13],  [15],  [16],  [17],  [19].  The  HSVD  is  a  new  canonic  matrix 
decomposition  which  we  define  by 

A  =  U DV,  where  U  is  unitary,  D  is  diagonal,  and  VT.V^  =  E,  (3) 

where  E,I]  are  signature  matrices  (i.e.,  diagonal  with  entries  ±1),  and  A  is  the  initial  given 
matrix  to  be  decomposed.  Note  that  in  V  we  again  have  a  hyperbolic  transformation.  The  well 
known  conventional  SVD  yields  the  eigenstructure  of  XiXl  directly  from  Xi  [Golub].  Likewise 
the  HSVD  yields  the  eigenstructure  of  A/2  directly  (without  outer  products)  from  the  matrix 
A  —  [XijA^a]-  More  specifically,  one  can  readily  see  that  with  E  =  diag(/,  —I)  the  U  matrix  in 
the  HSVD  contains  the  eigenvectors  of  A/2,  and  £)S£)‘  contains  its  eigenvalues.  We  establish 
the  canonicity  of  (3)  in  [19],  [13].  How  does  one  compute  the  HSVD?  We  have  constructed  two 
HSVD  algorithms,  one  serial  (based  on  Golub-Kahan  SVD  [Golub])  and  one  parallel  (based  on 
Hestene’s  SVD).  Simulations  show  that,  like  the  SVD,  these  HSVD  algorithms  are  numerically 
well  behaved  [15].  We  emphasize  that  the  HSVD  is  the  only  currently  available  algorithm  which 
avoids  outer  products  while  rendering  a  solution  to  (2)  for  arbitrary  A. 


1.3  Dissertations 


The  stabilized  Hyperbolic  Householder  wcis  the  topic  of  an  MS  Thesis  by  S.  So,  “Complex 
Stabilized  Downdating  in  Adaptive  Beamforming”,  Dec.  1989. 

The  HSVD  was  the  (partial)  topic  of  a  PhD  Thesis  by  R.  Onn,  Dept.  EE,  Cornell  University, 
Jan.  1992,  “Linear  Algebra  in  Sensor  Array  Processing”. 

The  grant  provided  some  (minimal)  stipend  for  these  students. 

1.4  Research  Impact 

A  number  of  researchers  have  expanded  on  our  work.  Here  is  a  partial  listing. 

The  stabilized  Hyperbolic  Householder  work  was  extended  by  Lektomeki  at  the  last  ICASSP 
in  Toronto  (April  1991)  in  the  context  of  sonar  detection. 

The  hyperbolic  Householder  has  also  been  applied  to  data  adaptive  windowing  at  ICASSP 
1991  by  Hseih,  and  to  subspace  updating  by  Bischoff  in  a  Jan.  1992  IEEE  SP  Transactions 
article.  The  Hyberbolic  Householder  has  also  been  applied  by  G.  Cybenko  of  U.  Illinois  in 
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List  of  Publications  supported  by  AFOSR-89-0267 

Most  of  these  publications  (denoted  by  *)  address  hyperbolic  transforms.  Those 
that  do  not  are  initial  explorations  into  enhanced  convergence,  which  will  be  de¬ 
tailed  further  in  the  final  report  for  “Enhanced  Convergence  Adaptive  Nulling”, 
AFOSR-91-0149. 

Refereed  Journal  Articles 

1.  *  “Stability  analysis  of  a  Householder  based  algorithm  for  downdating  the 
Cholesky  factor”,  A.  Bojanczyk  and  A.  Steinhardt,  SIAM  Journal  of  Sci. 
Computing,  Sept.  1991. 

2.  *  “Hyperbolic  Singular  Value  Decomposition  and  Applications” ,  R.  Onn, 
A.  Steinhardt,  and  A.  Bojanczyk,  IEEE  Trans,  on  Acoustics,  Speech,  and 
Signal  Processing,  July,  1991. 

3.  “On  the  PDF  of  adaptive  beamforming  weights”,  A.  Steinhardt,  IEEE 
Trans,  on  Acoustics,  Speech,  and  Signal  Processing,  May,  1991,  pp.l232- 
1235. 

4.  ‘“On  the  peaks  of  causal  signals  with  a  given  average  delay”,  J.  Makhoul 
and  A.  Steinhardt,  IEEE  Trans,  on  Acoustics,  Speech,  and  Signal  Pro¬ 
cessing,  April,  1991  pp.620-625. 

5.  “On  matching  Correlation  sequences  by  parametric  spectral  models”,  J. 
Makhoul  and  A.  Steinhardt,  IEEE  Trans,  on  Acoustics,  Speech,  and  Sig¬ 
nal  Processing,  Jan.  1991,  pp. 214-216. 

6.  *  ‘  Adaptive  Beamforming”,  A.  Steinhardt  and  B.  Van  Veen,  Int.  Journal 
Adaptive  Control  and  Signal  Processing,  Sept.  1989,  pp. 253-281. 

7.  *  “‘Stabilized  Hyperbolic  Householder  TVansformations” ,  A.  Bojanczyk 
and  A.  Steinhardt,  IEEE  Trans,  on  Acoustics,  Speech,  and  Signal  Pro¬ 
cessing,  Aug.  1989,  pp.  1286-1288. 

Invited  Presentations 

8.  *  “The  Hyperbolic  Singular  Value  Decomposition  and  Applications”,  A. 
Bojanczyk,  R.  Onn  and  A.  Steinhardt,  SVD  and  Signal  Processing  II, 
Algorithms,  Analysis  and  Applications,  edited  by  R.J.  Vaccaro,  Elsevier, 
1991,  pp. 132-148.  (Proc.  IEEE  SP  SVD  Wrkshp.,  RI,  June  1990.) 

Books 

9.  Adaptive  Radar  detection  and  estimation,  S.  Haykin,  A.  Steinhardt,  Edi¬ 
tors,  Wiley,  to  appear  1992.  Also  author  of  chapter  2,  “Adaptive  multi¬ 
sensor  detection  and  estimation”, to  appear,  March  1992, 


Conference  Presentations 


10.  “Where’s  the  Peak?”,  J.MakhouI  and  A.  Steinhardt,  Proc.  IEEE  Ini. 
Conf.  Acousi.,  Speech  and  Sig.  Proc.,  Toronto,  Canada,  May,  1991, 
pp.3361-3364. 

11.  “The  peak  of  a  causal  signal  with  a  given  average  delay”,  J.MakhouI 
and  A.  Steinhardt,  Proc.  5th  ASSP  Workshop  on  Spectrum  Estimation, 
Rochester,  NY,  Oct.  1990,  pp. 246-249. 

12.  *  “The  hyperbolic  SVD  and  applications”,  R.  Onn,  A.  Steinhardt,  and  A. 
Bojanczyk,  Proc.  5th  ASSP  Workshop  on  Spectrum  Estimation,  Rochester, 
NY,  Oct.  1990,  pp.285-288. 

13.  *  “Hyperbolic  SVD,  a  new  canonic  decomposition”,  R.  Onn,  A.  Stein¬ 
hardt,  and  A. Bojanczyk,  SIAM  Conf.  on  Linear  Alg.  and  Appl.,  San 
Diego,  CA,  July,  1990. 

14.  *  “Stable  complex  downdating  in  adaptive  beamforming”,  S.  So  and  A. 
Steinhardt,  Proc.  IEEE  Int.  Conf.  Acoust.,  Speech  and  Sig.  Proc.,  Alb., 
NM,  May  1990,  pp.2659-2662. 

15.  *  “The  hyperbolic  SVD  and  applications”,  R.  Onn,  A.  Steinhardt,  and  A. 
Bojanczyk  ,  Proc.  32nd  Midwest  Symposium  on  Circuits  and  Systems,  U. 
of  Ill.,  Aug.  1989  pp.575-577. 

16.  *  “A  linear  array  for  covariance  differencing  via  hyperbolic  SVD” ,  A.  Bo¬ 
janczyk  and  A.  Steinhardt,  Proc.  SPIE  Conf.  on  Advances  in  Signal 
Processing,  San  Diego,  Aug.  1989  pp.  103- 107. 

17.  *  “A  systolic  array  for  hyperbolic  SVD  based  covariance  differencing”,  A. 
Bojanczyk  and  A.  Steinhardt,  Proc.  3rd  Int.  Conf.  on  Systolic  Arrays, 
Kilnrey,  Ireland,  May  1989,  pp.247-254. 

18.  *  “Stabilized  hyperbolic  Householder  transforms”,  A.  Bojanczyk  and  A. 
Steinhardt,  Proc.  IEEE  Int.  Conf.  Acoust.,  Speech  and  Sig.  Proc.,  Glas- 
cow,  Scotland,  May  1989,  pp.  1278-1281. 

In  Review  and  To  Appear 

19.  *  “Hyperbolic  singular  value  decomposition”,  R.  Onn,  A.  Bojanczyk,  and 
A.  Steinhardt,  J.  Ltn.  Al.  Appl.,  in  second  stage  of  review  cycle. 


recent  work  to  appear  in  Int.  J.  Linear  Algebra  and  Applications  in  the  context  of  parallel 
computation  of  low  displacement  rank. 

Chen,  Kailath,  and  Luk  have  used  HSVD  concepts  in  singular  displacement  rank  theory. 

Two  new  textbooks  discuss  our  Hyperbolic  Householder  device;  (i)  S.  Haykin, “Adaptive 
Filter  Theory”,  Wiley,  1991,  and  (ii)  S.  Farina,  “Radar  Signal  Processing”,  Artech  House,  1992. 

We  mention  for  completeness  independent  work  by  DeMoor  (U.  Ill.)  which  generalizes  the 
HSVD,  by  generalizing  the  form  of  S.  (De  Moor  has  since  incorporated  our  work  in  his  presen¬ 
tation.) 

[Golub]  G. Golub  and  C.  Van  Loan,  Matrix  Computations,  John  Hopkins  Press,  1983. 

[Monzingo]  R.Monzingo  and  T. Miller,  Introduction  to  Adaptive  Arrays  Wiley,New  York, 1980. 

[Haykin]  S.  Haykin, Adaphue  Filter  Theory,  Prentice- Hall,  1986. 

[Rader]  C. Rader  and  A.Steinhardt,  “Hyperbolic  Householder  Transformations”,  IEEE  Trans. 
Acoust.,  Speech,  Signal  Proc.,  {IEEE  ASSP),  Dec.  1986,  also  SIAM  J.  on  Matrix  Anal,  and 
AppL,  April,  1988. 

[Paulraj]  A.Paulraj  and  T. Kailath, “Eigenstructure  methods  for  direction  of  arrival  estima¬ 
tion  in  the  presence  of  unknown  noise  fields”,  IEEE  ASSP,  Feb.  1986. 

[Kaveh]  J. Pierce,  M. Jacobsen,  and  .M.Kaveh,  “A  Laboratory  testbed  for  sensor  array  process¬ 
ing”,  32nd  midwest  symp.  on  circtiits  syst..  Champ. ,111.,  1989  M.S.  Thesis,  Cornell  University, 
in  preparation. 
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